Papers with Kahneman-Tversky Optimization
Mitigating Geospatial Knowledge Hallucination in Large Language Models: Benchmarking and Dynamic Factuality Aligning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have extensive world knowledge, but often generate inaccurate geospatial knowledge. |
| Approach: | They propose a framework for evaluation of large language models to mitigate hallucinations . they use Kahneman-Tversky Optimization to align LLMs with their reality . |
| Outcome: | The proposed evaluation framework uncovers hallucinations in 20 advanced LLMs. |
Controlling Distributional Bias in Multi-Round LLM Generation via KL-Optimized Fine-Tuning (2026.acl-long)
Copied to clipboard
| Challenge: | Existing evaluation methods focus on single-round inference, but this view is problematic in real-world applications. |
| Approach: | They propose a framework that couples Steering Token Calibration with Semantic Alignment to ensure that LLMs are correctly aligned across gender, race, and sentiment. |
| Outcome: | The proposed framework outperforms baseline methods in achieving precise distributional control in attribute generation tasks. |
Beyond Binary Preferences: Semi-Online Label-Free GRACE-KTO with Group-Wise Adaptive Calibration for High-Quality Long-Text Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Generating high-quality long-text remains challenging for Large Language Models (LLMs), as conventional supervised fine-tuning fails to ensure overall quality due to its teacher-forcing nature. |
| Approach: | They propose a semi-online framework that transforms KTO’s binary signals into dynamically calibrated intra-group rewards. |
| Outcome: | The proposed framework transforms binary signals into dynamically calibrated intra-group rewards. |
FactAlign: Long-form Factuality Alignment of Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have demonstrated significant potential as the next-generation information access engines, but reliability is hindered by issues of hallucination and generating non-factual content. |
| Approach: | They propose a novel alignment framework that enhances the factuality of LLMs’ long-form responses while maintaining their helpfulness. |
| Outcome: | The proposed framework improves factuality of LLMs while maintaining helpfulness. |